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This listing of claims replaces all prior versions, and listings, of claims in this application, 
l istin p of Claims: 

1 . (Currently Amended) A method for certifying a software product's reliability, 

said method comprising: 

establishing a software certification laboratory; 

receiving the software product at the software certification laboratory; 

instrumenting the software product, by the software certification laboratory, to collect a 
plurality of usage data and a plurality of failure data when the software product is being 
executed; 

di gitally sign in g the software produc t to be verified: 
verifying the di gital signature of the software product; 

^pinyin p „ residual testis tool in the softw are product th at collects information about 
the software product behavi or as the software product is used; 
providing the software product to a plurality of users; 

receiving, at the software certification laboratory, the plurality of usage data and the 
plurality of failure data from each of the plurality of users; 

analyzing the plurality of usage data and the plurality of failure data; 

building an operational profile according to a result from the analyzing; and 

issuing a certificate of reliability to the software product based on the result from the 
analyzing. 
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2. (Previously Presented) The method of claim 1, wherein the software certification 
laboratory is independent of a vendor that provides the software product. 

3 . (Previously Presented) The method of claim 1 , wherein the operational profile is 
returned from the software certification laboratory to a vendor that provides the software product 
for reference. 

4. (Canceled) 

5. (Currently Amended) The method of claim 1-4, wherein the signature of the 
software product is signed by a software product vendor. 

6. (Currently Amended) The method of claim 1-4, wherein the signature of the 
software is verified by the software certification laboratory. 

7. (Previously Presented) The method of claim 1 , wherein the certification is 
presented by computing a Mean Time to Failure (MTTF) for the software product, wherein the 
MTTF is given by 



product, and U represents the time for each version before encountering a failure. 

8. (Currently Amended) A system for certifying a software product's reliability, 
comprising: 

a software product received from a product vendor; and 

a software certification laboratory for instrumenting the software product to collect 
information about the software behavior when the software product is used, 



MTTF = 



N 



, wherein TV is a number of instrumented versions of the software 
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wherein the software product, after intrumented by the software certification laboratory, 
is used by a plurality of users, and the information collected by the software products includes a 
plurality of usage data and a plurality of failure data from each of the plurality of users, 

wherein the software certification laboratory receives and analyzes the plurality of usage 
data and the plurality of failure data from each of the plurality of users collected by the software 
product, builds an operational profile according to a result from the analyzing, and issues a 
certificate of reliability to the software product , and 

wherein the software certification laboratory is further configured to: 
digitally sign the software product to be verified: 
verify the digital signature of the software product; and 
employ a residual testing tool in the software product that collects information 
about the software product behavior as the software product is used . 

9. (Previously Presented) The system of claim 8, wherein the software certification 
laboratory instruments the software product with a residual testing tool that collects information 
about the software behavior when the software product is used. 

10. (Previously Presented)The system of claim 8, wherein the software product is 
provided by a software vendor that is independent from the software certification laboratory. 

1 1 . (Previously Presented) The system of claim 1 0, wherein the vendor provides a 
digital signature on the software product. 

1 2. (Previously Presented) The system of claim 1 1 , wherein the software certification 
laboratory verifies the digital signature of the software product. 
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13. (Previously Presented) The system of claim 8, wherein the operational profile is 
returned from the software certification laboratory to a vendor that provides the software product 
for reference. 

14. (Previously Presented) The system of claim 8, wherein the collected data is 
scrubbed of personal information of the plurality of users. 

15. (Previously Presented) The system of claim 8, wherein the software certification 
laboratory instructs the software product to collect the information periodically. 

1 6. (Previously Presented) The system of claim 8, wherein the certification is 
presented by computing a Mean Time to Failure (MTTF) for the software product, wherein the 
MTTF is given by 

N 

MTTF = — — , wherein N is the number of instrumented versions of the software 
N 

product, and U represents the time for each version before encountering a failure. 

1 7. (Previously Presented) A method for certifying a software product's reliability, 
comprising: 

employing a residual testing tool to the software, wherein the residual testing tool is 
configured to collect information about the software product behavior as the software product is 
used; 

digitally signing the software product; 

distributing the signed software product to a software certification laboratory, wherein the 
software certification laboratory verifies the digital signature of the software product and 
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instruments the residual testing tool employed in the software product to collect information 

about the software product behavior; 

distributing the verified software product to a plurality of users, wherein the residual 

testing tool collects a plurality of usage data and a plurality of failure data from each of the 

plurality of users while the software product is used; 

reporting the collected usage and failure data to the software certification laboratory; and 
analyzing the collected data to issues a certificate of reliability to the software product. 

1 8. (Previously Presented) The method of claim 1 7, wherein the software certification 
laboratory further builds an operational profile according to a result from the analyzing. 

1 9. (Previously Presented) The method of claim 1 7, wherein the certification is 
presented by computing a Mean Time to Failure (MTTF) for the software product, wherein the 
MTTF is given by 



N 



S'. 



MTTF = 



N 



, wherein N is a number of instrumented versions of the software 



product, and /, represents the time for each version before encountering a failure. 



